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PACKET MESSAGING METHOD AND APPARATUS 

The present invention relates to a method of and apparatus for the management of 
packet messaging. The invention has application, in particular, in the optimal 
management of a certain class of packet messaging over a low bandwidth link. 

A wide variety of situations are known where a source entity transmits messages 
over a communications link to a receiving entity. A well known subset of this variety 
of situations involves the communications link over which the source entity transmits 
its messages having an insufficient bandwidth to be able to carry the volume of 
messages intended for the receiving entity. 

One crude solution to this problem would simply be to send as many messages as 
can be sent at any given time and then to discard any remaining 'overflow' 
messages. Whilst having the merit of simplicity, this solution cannot provide an 
efficient utilisation of the communication link. A sudden burst of activity may lead to 
a flood of messages with the overflow messages being discarded. Following the burst 
of activity however, the communications link may return to being only lightly loaded. 

An improved solution would provide for the buffering of the overflow messages. The 
overflow messages would not then simply be discarded if they could not be sent at 
any given time, but could be buffered and sent following the burst of activity, when 
the communications link had returned to being only lightly loaded. It will be clear that 
there will be limits to the size of the message buffer, however, such that it might be 
imagined that the buffer itself might overflow. It will also be clear that there Is no 
substantive discrimination between the messages, all messages being treated as 
being of equal importance. 

A different approach altogether may be applied in certain circumstances where the 
messages may be considered as being of different importance. As and when 
congestion on the communications link between the source entity and the receiving 
entity occurs, more important messages may be transmitted over the communications 
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link whereas less important messages may be discarded, or buffered as discussed 
above. 

A well known example of such an approach with a single source entity is the concept 
5 of 'layered video coding'. Such an approach could just as well be applied to a number 
of competing source entities however, where the source entities and hence their 
respective messages are ranked according to their importance. 

A problem having somewhat different characteristics from the preceding situation is, 
10 rather, one where there are a number of competing yet equally important source 
entities all transmitting the same type of message. An example might be a number of 
source entities that transmit messages as to some aspect of their state. Mobile 
entities might, for example, transmit messages as to their location. Likewise, sensor 
entities might transmit messages as to ambient temperature or pressure. 

15 

A more familiar example might be that of a networked computer game such as 
'Quake' (created by ID Software of Mesquite, TX, USA), where mobile creatures are 
created in a three-dimensional virtual environment running on one or more server 
computers. The positions of these creature source entities may be messaged to game 
20 entities hosted on client computers connected to the server or servers as appropriate. 

Typically, what will be most important for the entity receiving such periodic state 
update messages, is to ensure that regular updates are received from all the source 
entities. If a number of source entities are sending messages with state updates, it 
25 will typically be more important to receive regular state updates from all the source 
entities than to receive all the state updates from a subset of the source entities and 
few, if any, state updates from the remaining source entities. This is to say that it is 
typically more important to keep down the maximum possible state error of source 
entities rather than the average state error of all the source entities. 

30 

To use the example of a game such as Quake again, if a game player's character is 
surrounded by highly mobile hostile creatures, it may well be more important for the 
game player's character to know where all the relevant creatures are (or rather where 



they all were a short time ago) to within a relatively small error rather than knowing 
where a subset of the creatures are to within a very small error {where they are now) 
with the remainder of the (highly mobile hostile) creature's positions only being 
known with a relatively large error (where they were a while ago). 

It will be clear that a simple hierarchically oriented scheme such as a layered video 
coding scheme cannot provide for such a situation. As indicated above, in such a 
scheme all available information may be required from the most important source 
entities at the expense of receiving little, if any, information from the less important 
source entities whereas having regard to the problem under consideration, at least 
some information is required from all the source entities, each being nominally of the 
same importance. 

Thus, according to the invention, there is provided a Link Manager for managing the 
sending of packet messages on a link; 

the packet messages originating from a plurality of packet message sources; 
each packet message source having an associated state; each packet message 
including an associated packet message priority setting on a scale of n to m 
and a packet message source state update; 

each packet message having been sent by a source sending sequences of m - 
n+1 packet messages cycling through each priority setting of said priority 
setting scale such that successively dropping packet messages from the 
sequence on a priority basis leaves the remaining packet 
messages of the sequence as evenly spaced as possible; 

the Link Manager comprising: 

at least one packet message input port to receive such packet messages; 

means arranged to read the priority setting associated with each such received packet 
message 



i 



A25771.DOC 




means arranged to sort each such received packet message into a packet message 
queue on the basis of the priority setting associated with each such received 
packet message; 

5 means arranged to test the link for sufficient capacity to send the packet message at 
the head of the queue; and 

means arranged to send the packet message at the head of the queue, when the link 
has sufficient capacity, out through at least one output port onto the link. 

10 

Advantageously, this will ensure that, when a number of packet message source 
entities are sending such packet messages, despite increasing link congestion, as far 
as possible packet messages representing regular state updates from all the source 
entities are sent onto the link to a receiving client , rather then all the state updates 
1 5 from a subset of the source entities and few, if any, state updates from the remaining 
source entities as with the prior art. 

A method of managing the sending of packet messages from a plurality of sources on 
a link is also provided. 

20 

Several embodiments of the invention will now be described, by way of example, 
having regard to the accompanying drawings, in which: 

25 Figure 1 illustrates a first embodiment according to the invention; 

Figure 2 illustrates a general purpose computer; 

Figure 3 illustrates a packet message structure; 

30 

Figures 4A and 4B illustrates first procedural flowcharts; 



Figure 5 illustrates a second procedural flowchart, having regard to a second 
embodiment according to the invention; 

Figure 6 illustrates a third procedural flowchart, having regard to the second 
embodiment according to the invention; 

Figure 7 illustrates a first graph, showing performance results for the second 
embodiment; 

Figure 8 illustrates a second graph, showing further performance results for the 
second embodiment; 

Figures 9A and 9B illustrate a fourth procedural flowchart, having regard to a third 
embodiment according to the invention; 

Figure 10 illustrates a third graph, showing performance results for the third 
embodiment; 

Figure 1 1 illustrates a fourth graph, showing further performance results for the third 
embodiment; and 

Figure 12 illustrates a fourth embodiment according to the invention. 

A first embodiment according to the invention will now be described having regard to 
Figures 1, 2, 3 and 4. Figure 1 illustrates in schematic form, a first embodiment 
architecture according to the invention. Figure 4 illustrates a procedural flowchart of 
the functioning of this first embodiment. 

Each one of a first group of source entities, each source entity having an associated 
state, creates and sends packet messages containing information as to its current 
state. The destination entity or entities to which the messages are sent will be 
discussed below. The source entities can take a wide variety of forms; one example 
of such a form is that of an entity hosted within a software process on a computer. 
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Figure 1 thus illustrates, by way of example, a group of source entities 100 as being 
hosted within a first software process 102 on a first server connputer 104. 

5 Such a computer 104 is as illustrated in Figure 2 and will typically have at least a 
central processing unit (CPU) 202, read-only memory (ROM) 204, random-access 
memory (RAM) 206,, a storage device such as a hard disk 208, a device for reading 
from and writing to storage media such as a floppy disk drive 210 for reading from 
and writing to floppy disks and input and output ports 212 for connection to other 
10 devices or communications networks. 

The computer 104 may utilise any suitable operating system, well known examples 
being Microsoft Windows'" NT , Linux or any one of the other many versions of Unix. 
Application programs may be written in any of many well known suitable languages in 
15 which to write application programs, one well known example of which is C-f +. 
Such an operating system and application programs may be loaded onto the storage 
device 208 of the computer 104. 

Aspects of the functionality disclosed in accordance with the embodiments of the 
20 invention may be implemented as software application programs to be executed by 
the computer 104. This software application program may then be stored in any 
suitable computer readable storage media form, for example on a floppy disk 214, for 
loading into the computer 104, via the floppy disk drive 210, for execution. A well 
known alternative would be to store the software application on a CD-ROM (not 
25 shown) for loading into the computer 104 via a CD-ROM drive (not shown) for 
execution. A further well known alternative would be to download the software 
application program over a suitable network (not shown), for execution by the 
computer 104. 

30 In this embodiment the computer 104 has one or more software application programs 
loaded onto it which, when executed, will cause the computer 104 to operate as 
such a host for source entities. 
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Often, there will be more than one such server computer. Accordingly a second group 
of source entities 100' is illustrated, hosted in a second software process 102' on a 
second server computer 104'. 

5 As with the example of Quake above, the source entities could, for example, be 
creatures inhabiting a three-dimensional virtual environment, with different portions of 
the virtual environment running as processes on one or more of the server 
computers. By way of a simple example, a group of creatures in one room of a virtual 
environment might be represented by the source entities running in a process on one 
10 server computer and another group of creatures in another room of the virtual 
environment might be represented by the source entities running in another process 
on a second server computer. 

As indicated above, each source entity 100 has an associated state; in this example 
15 each character will have at least an associated position within the virtual 
environment. Thus, each character, moving about in the three-dimensional virtual 
environment, may create and send packet messages as to their respective current 
positions in the three-dimensional virtual environment. 

20 An example of the structure of such a packet message is illustrated in Figure 3. As is 
conventional, the packet message 300 has both a header portion 302 and a payload 
portion 304. It is to be noted that not all the fields in the packet header 302 will be 
simultaneously required for all the embodiments of the invention. 

25 A first field 306 in the packet header 302 contains an indication of the identity of the 
source entity. A second field 308 in the packet header 302 contains an indication of 
the identity of the intended destination entity. With only one destination in this first 
embodiment, this field need not be set. A third field 310 in the packet header 302 
contains an indication of assigned priority, on a given priority scale. 

30 

According to the invention, the third field 310, identifying a priority setting, will be 
set as follows. Each individual packet message is assigned a priority setting on a 
scale of for example, 0 (lowest priority) to n (highest priority). Crucially, a sequence 




8 

of n + 1 such messages is sent out from the source entity, not with a fixed priority 
assigned to the source entity in question, but with cyclically varying priorities. The 
cyclic priorities vary such that if packets were discarded on a priority basis, the 
remaining packets in the sequence would be left as evenly spaced as possible. 

5 

For a simple example where n = 7, a corresponding suitable cyclic variation in priority 
is a sequence of eight messages (equally spaced in time) with priorities set at 0, 7, 2, 

4, 1, 6, 3 and 5 respectively. The O, 7, 2, 4, 1, 6, 3, 5 sequence will ensure that as 
successive low priorities have to be dropped the remaining packets will be as evenly 

10 spaced as possible. By way of example, if half the packets had to be dropped from 
such a sequence of eight messages due to a traffic load of twice link capacity (thus 
becoming I ],7, 2, 4, 1, 6, 3, 5 then [ ], 7, 2, 4, [ ], 6, 3, 5 then [ ], 7, [ ], 4, [ ], 6, 3, 

5, and finally [ ], 7, [ ], 4, [ ], 6, 1 ], 5) it will be seen that the remaining packets are 
still equally spaced in time and will neatly provide updates every two temporal 

1 5 periods, rather than every temporal period as with the original sequence. 

A fourth field 312 in the packet header 302 contains an indication of a so-called time- 
to-live. The time-to-live would be indicated as a given period of time, ranging, for 
example, up to a couple of hundred milliseconds, rather than being indicated as a 
20 given number of link hops is often the case in packet networks. In the first 
embodiment this field is not set. 

A fifth field 314 in the packet header 302 indicates a payload type. The payload type 
might be, for example, that for a position indication. In the first embodiment this field 
25 is not set. 

The packet payload portion 304 carries data. In this example the typical payload will 
be a position indication. 

30 Having regard to Figure 4A, in a first step 400 then, a source entity creates and 
sends a stream of such packet messages, carrying positional updates in the packet 
payloads and cyclically varying priorities in the fourth field of the packet headers. 
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Returning to Figure 1, the first and second server computers 104, 104' will have first 
and second server computer output ports 106, 106' respectively. These respective 
first and second server computer output ports 106, 106' are connected by respective 
first and second high-bandwidth links 108, 108' to a link management computer 110. 
Such high-bandwidth links 108, 108' may typically take the form of, for example, 
Fast Ethernet, with an associated bandwidth of, for example, lOOMbits per second. 

The link management computer 110 may take the form of a general purpose 
computer as illustrated in Figure 2. The link management computer 110 may utilise 
any suitable operating system, well known examples being Microsoft Windows^" NT , 
Linux or any one of the other many versions of Unix. Application programs may be 
written in any of many well known suitable languages in which to write application 
programs, one well known example of which is C + +. Such an operating system and 
application programs may be loaded onto a storage device 208 of the computer 1 10. 

The functionality disclosed in accordance with the embodiments of the invention may 
be implemented as software application programs to be executed by the link 
management computer 110. This software application program may then be stored in 
any suitable computer readable storage media form, for example on a floppy disk 
214, for loading into the computer 110, via the floppy disk drive 210, for execution. 
A well known alternative would be to store the software application on a CD-ROM 
(not shown) for loading into the computer 110 via a CD-ROM drive (not shown) for 
execution. A further well known alternative would be to download the software 
application program over a suitable network (not shown), for execution by the 
computer 1 10. 

The link management computer 110 has at least one input port 112, through which 
the link management computer receives the packet messages sent by the source 
entities. In this example, with two server computers 104, 104' , first and second link 
30 management computer input ports 112, 112' are illustrated, it will be appreciated 
that these first and second link management computer input ports 112, 112' may be 
either separate physical ports or a shared physical port separated at the software 
level. 



10 
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In a second step 402, the packet nnessages sent by the source entities hosted in the 
first and second server computers 104, 104' are thus sent to the link management 
computer 110 via the respective first and second server computer output ports 106, 
5 106' , the first and second fast links 108, 108' and the first and second link 
management computer input ports 112, 112' . The links between the respective 
server computers and link management computer are of a sufficiently high bandwidth 
that the packet messages sent by the source entities can be carried to the link 
management computer with a delay which is insignificant compared to the further 




10 downstream delays. 



In this embodiment the link management computer 110 has one or more software 
application programs loaded onto it which, when executed, will cause the link 
management computer to run a Link Manager process 114. The appropriate steps of 
1 5 the procedural flowcharts will be carried out through execution of the software 
application programs. 

In a third step 404, the Link Manager process 114 receives the packet messages 
arriving at the first and second link management computer input ports 112, 112' . In 
20 a fourth step 406, the Link Manager process 114 reads the priority setting from the 
fourth field 312 of the packet headers 302 of the received packets. 




In a fifth step 408, the Link Manager process 1 14 sorts the packet messages that 
arrived at the first and second link management computer input ports 112, 112' into 

25 a simple sorted linear packet queue 116 ordered on priority. The packet message 
might, for example, be sorted into the queue 1 1 6 at the rear of the group of packet 
messages with the same priority setting. It will be appreciated that, by way of an 
alternative, the portions of the simple queue 1 16 with the same priority settings could 
just as easily be queued, in an optimised implementation as separate queues for each 

30 priority setting. 

It will be appreciated that in a further step (not shown), the length of the packet 
queue 1 16 could be checked, and packet messages being stored as to increase the 
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length of the queue 1 16 beyond a predetermined limit queue length could be 
discarded. 



The link management computer 110 also has at least one output port 1 18. 

5 

The output port 1 1 8 of the link management computer 110 is connected, by means 
of a link 120 of known Quality-of-Service and, in particular, a known low-bandwidth, 
to, for example, an input port 122 of a receiving entity host computer 124 . When 
the Link Manager process 114 sends the packet message at the head of the priority 
10 queue 116 to the link management computer output port 118, the message is then 
transmitted over the communication link 120 to the receiving entity host computer 
124, which can then pass the message to the receiving entity {not shown). 



Having regard to Figure 4B, in a step 410, the Link Manager will test to see if there is 
15 spare capacity on the low bandwidth link to send the packet message at the head of 
the queue 116, If there is, in a further step 412, the Link Manager process 114 will 
send the packet message at the head of the priority queue 116 to the link 
management computer output port 118 and out onto the link 120. If there is not, 
then step 410 will be repeated. It is important to do this as an intelligent selection of 
20 packet messages has effectively been made at the link manager according to the 
invention through the cyclic priority scheme; overloading the link might simply cause 
a return of random packet message loss, losing the fruits of the invention. 



It will be appreciated that the sending of the packet message at the head of the 
25 queue 116 will thus involve a loop process. The Link Manager process 114 must wait 
until the current head of queue packet message has been sent before attempting to 
send the next head of queue packet message. This might be achieved, for example, 
with the Link Manager process ascertaining the size of the packet message at the 
head of the queue 1 16, which can then be used, with a knowledge of the Bandwidth 
30 of the link 120, to compute how long the head of queue packet message will take to 
be sent. By way of an alternative, the packet messages for sending could be sent 
from a buffer, into which a following packet message cannot be written till the 
previous packet message has cleared the buffer. 
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A typical low-bandwidth link 120 might, for example, be a 33.6 kbits per second 
Modem link over a Public Switched Telephone Network (PSTN) connection or a 128 
kbits per second Integrated Services Digital Network (ISDN) connection. 

5 

By way of example, the receiving entity host computer 124 might run a process 
which hosts an entity intended to receive the messages sent by the source entities. It 
will be appreciated however, that instead of the receiving entity host computer, a 
receiving entity might instead take a wide variety of forms, not even having to take a 




10 computationally capable form, for example, a simple data store. 



For as long as the total bandwidth of the packet message traffic received by the link 
management computer 1 10 at any given time has been less than the known low- 
bandwidth of the communication link 120, all packet messages placed in the Link 
1 5 Manager process queue 116 will be sent out on the link 1 20 with no queuing delay. 
The receiving entity will receive all the packet messages sent from all the source 
entities with the lowest possible delay (which will result only from the network 
delay). 



20 It may be the case, however, that increasing numbers of source entities 100 ,100' 
become active, resulting in a commensurately increased flow of messages. 
Alternatively, the source entities 100, 100' themselves may become more active, 
resulting in the need for state update messages with reduced periodicity. In either 
case, as the amount of packet message traffic increases, there will come a point 

25 when the total bandwidth of the incoming packet message traffic exceeds the 

bandwidth of the communication link 120. At this point it will no longer be possible 
to send on simultaneously all the packet messages intended for the receiving entity. 

The packet messages will now begin to be queued by the Link Manager process 114, 
30 ordered, as indicated above, on the basis of priority. As new packet messages arrive 
at the link management computer 1 10 they will be sorted into the section of the 
queue appropriate to the priority setting carried in their packet header 302. 
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The discussion as to the cyclic priority settings of the sequences of packet messages 
sent out from the source entities 100, 100' will be recalled. The example was 
provided above, of the management of the selecting of packets for sending on a link 
with a traffic load running at twice link capacity. If half the packets were dropped 
5 from a sequence of eight messages with cycled priority sequences of the form 0, 7, 
2, 4, 1, 6, 3, 5 due to a traffic load of twice link capacity (thus becoming [ ],7, 2, 4, 
1, 6, 3, 5 then [ ], 7, 2, 4, [ ], 6, 3, 5 then [ ], 7, [ ], 4, [ ], 6, 3, 5, and finally [ ], 7, [ 
], 4, [ ], 6, [ ], 5) it was seen that the remaining packets were still equally spaced in 
time and would neatly provide updates every two temporal periods, rather than every 
10 temporal period as with the original sequence. 

Thus when the Link Manager process 114 begins to queue packet messages on a 
priority basis, it will effectively begin to drop (or rather queue) the lower priority 
messages whilst sending on the higher priority messages, in an cyclic order similar to 

15 the example given above. In this way, a link management computer 110 according to 
this embodiment of the invention, with an increasingly congested link 120 , will be 
able to continue to send regular state updates from all the source entities 100, 100'. 
Naturally, these updates, whilst remaining regular, will become less and less frequent 
with rising low-bandwidth link 120 congestion, but this gradual falling away of 

20 frequency indicates the graceful manner in which the degradation of service takes 
place. 

Simulated performance results for this first embodiment will be discussed below 
having regard to a comparison with the performance results of the third embodiment 
25 illustrated in Figures 10 and 1 1 . 

A second embodiment according to the invention will now be discussed having regard 
to Figures 1, 2, 3, 5, 6, 7 and 8. This second embodiment differs from the first only 
in terms of the structure of the packet messages 300 sent by the source entities 
30 100, 100' and in the functionality of the Link Manager process 114, so reference 
should again be made to Figures 1, 2 and 3 where appropriate. Figures 5 and 6 
illustrate procedural flowcharts of aspects of functioning of this second embodiment 
according to the invention. Again the appropriate steps of the procedural flowcharts 
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will be carried out through the execution of the software application programs running 
on the link management computer 110. 

According to this second embodiment and having particular regard to Figures 1 and 2, 
5 the source entities 100, 100' transmit packet messages 300 with the following 
structure. The first field 306 in the packet header 302 will be set with the identity of 
the sending source entity. The second field 308 in the packet header 302, identifying 
a destination entity, need not be set as there exists only one destination entity in this 
example. 

10 

The third field 310, identifying a priority setting, will be set as with the first 
embodiment. Each individual packet message is assigned a priority setting on a scale 
of for example, 0 (lowest priority) to n (highest priority). Again crucially, a sequence 
of n + 1 such messages is sent out from the source entity, not with a fixed priority 
1 5 assigned to the source entity in question, but with cyclically varying priorities. The 
cyclic priorities vary such that if packets were discarded on a priority basis, the 
remaining packets in the sequence would be left as evenly spaced as possible. 

Again, for a simple example where n = 7, a corresponding suitable cyclic variation in 
20 priority is a sequence of eight messages with priorities set at 0, 7, 2, 4, 1, 6, 3 and 5 
respectively. As indicated above, the 0, 7, 2, 4, 1, 6, 3, 5 sequence will ensure that 
as successive low priority packet messages have to be dropped, the remaining packet 
messages will be as evenly spaced as possible. 

25 In this second embodiment the fourth field 312 will be set with a time-to-live period. 
It will be appreciated that rather than all source entities needing to have the same 
packet message sending periodicity, varying time-to-live indications allow each source 
entity to set their own periodicity. For example, as a result of its nature, a given 
source entity might only need to send updates every 20 nominal time periods, in 

30 which case a time-to-live period could be set at 20 nominal time periods. After 20 
such nominal time periods, the given source entity will send out a new update so the 
older update may be discarded. 
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In this second embodiment, the fifth field 314 in the packet header 302, giving an 
indication of the packet payload type, is not set. 



Streams of such packet messages, bearing cyclic priority settings, as discussed 
5 above, are sent out from the source entities 100, 100'. These packet messages are 
then passed, via the respective first and second server computer output ports 106, 
106' and first and second links 108, 108', to the link management computer 1 10. 

Having regard to Figure 5, in a first step 500, after these packet messages are 
10 received at the first and second link management computer input ports 112, 112', 
they are passed to the Link Manager process 1 14. 

The Link Manager process 114 will again maintain a simple packet message queue 
116, ordered on priority, as with the first embodiment. 

15 

The Link Manager process 1 14 is provided with a clock (not shown) keeping a local 
time measured cyclically in, for example milliseconds. In a second step 502, the Link 
Manager process 114 reads the time-to-live setting in the fourth field 312 of the 
respective packet headers 302 and in a third step 504, adds the local clock time to 
20 the time-to-live setting assigned by the source entity, to create an adjusted time-to- 
live. In a fourth step 506, this adjusted time-to-live is then written back into the 
fourth field 312 of the packet header 302. 

It will be appreciated that, by way of an alternative, the packet message and an 
25 associated arrival time could instead be stored together in the queue 1 16. This would 
have the advantage of not writing over the source entity set time-to-live but would 
have the disadvantage of a commensurately larger queue memory requirement. 



It will be appreciated that the only significant delay which may be experienced by a 
30 given packet message will be that resulting from being held in a queue. If, by way of 
the example used above, a given packet message is received by the Link Manager 
process 1 14 with a time-to-live indication of 20 nominal units and the Link Manager 
process local time was t= 100 nominal units, then the adjusted time-to-live written 
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into the fourth field of the packet header would be 120 nominal units. If, for reasons 
discussed below, this packet message was queued for more than the 20 nominal 
units lifetime, by which time the Link Manager process local time would be t= 120 
nominal units, then the packet message should be timed-out. The source entity 
5 should have sent, and the Link Manager process 1 16 should have received, another 
packet message by this time. 

In a fifth step 506, the Link manager process 114 also reads each priority setting in 
the third field 310 of the respective packet headers 302 and then, in a sixth step 
10 510, sorts the packet messages into the simple queue 116 ordered on the basis of 
the priority setting. Again, the packet message might, for example, be sorted into the 
queue 1 16 at the rear of the group of packet messages with the same priority setting. 
As indicated above, again, by way of an alternative, the portions of the simple queue 
116 with the same priority settings could be queued separately. 

15 

The process illustrated in Figure 6 is to be understood as being executed in parallel 
with that illustrated in Figure 5. 

Having regard to Figure 6, in a first step 600, as each new packet message moves up 
20 to the head of the queue 116 for sending onto the link 1 20, the Link Manager process 
1 14 will again read the adjusted time-to-live setting from the fourth field 312 of the 
packet header 302 of the packet message at the head of the queue 116. 

In a second step 602, the Link Manager 114 will compare this adjusted time-to-live 
25 with the Link Manager process local time. In a third step 604, if the Link Manager 
process local time has passed the adjusted time-to-live of the packet message, then 
that packet message must be considered as being timed-out and will be discarded by 
the Link Manager process 114. If, however, the Link Manager process local time has 
not passed the adjusted time-to-live of the packet message, then the packet message 
30 will not have been queued for longer than its assigned time-to-live and in a fourth 
step 606, will next be sent, via the output port of the link management computer 
118, onto the link and to the receiving entity at the client 120. The Link Manager 



.DOC 



17 

process 1 14 will again test the link 1 20 for capacity to send the packet message at 
the head of the priority queue 1 16 in doing so, as with the first embodiment. 

It will be appreciated that for optimal utilisation of the bandwidth available on the 
5 low-bandwidth link, a step of header compression (not shown) may take place. 
Portions of the header 302 no longer necessary since the packet message is to be 
sent out over the low-bandwidth link 1 20, for example, the priority setting, may be 
stripped off. 

10 As with the first embodiment, for as long as the instantaneous total bandwidth of the 
packet message traffic received by the link management computer 110 has been less 
than the known (low) bandwidth of the communication link 120, all packet messages 
placed in the Link Manager process queue 116 will be sent out on the link with no 
queuing delay. The receiving entity 124 will receive all the packet messages sent 

15 from all the source entities 100, 100'. Again, however, as with the first embodiment, 
as the amount of packet message traffic increases, there will come a point when the 
total bandwidth of the incoming packet message traffic exceeds the bandwidth of the 
communication link 120. At this point it will no longer be possible to send on 
simultaneously all the packet messages intended for the receiving entity. 

20 

The second embodiment according to the invention will provide all the advantages of 
the first embodiment according to the invention in terms of the cyclic priority settings 
being able to deliver an optimal and graceful degradation of service as the total traffic 
bandwidth exceeds the low-bandwidth link capacity. The second embodiment 
25 according to the invention will, however, provide yet further advantages in terms of 
performance over the first embodiment, as will now be explained. 

The assignment of a time-to-live for each message allows the avoidance of an 
erroneous re-ordering of messages as follows. 

30 

A first positional packet message is sent from a given source entity at a nominal t = 0 
with a priority setting of 0. A second packet message is sent at nominal t = 1 with a 
priority setting of 7. A third packet message is sent at nominal t = 2 with a priority 
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setting of 2. If. due to a degree of congestion on the low bandwidth link 120, the 
first packet message, with the lowest priority setting of 0, is not sent over the link by 
the Link Manager process 114 when it is received, it will instead be queued. Upon 
receipt of the second and third packet messages, with respective priority settings of 
5 7 and 2 respectively, the Link Manager process 114 sends the second and third 

packet messages straight out over the low bandwidth link 120 to the receiving entity 
host computer. If the congestion on the low bandwidth link 120 had then eased and 
if the first packet message had not had a limited time-to-live associated with it, the 
Link Manager process 1 14 might then have sent the first message over the low 
10 bandwidth link to the receiving entity host computer. 

Had the Link Manager process 114 done so, it would have had the result that the 
latest positional update message received by the client would in fact have dated from 
one and two time periods respectively before the positional updates carried by the 
1 5 second and third messages which had already been received by the client. Instead, 
the time-to-live setting on the message will cause the message to be discarded from 
the Link Manager process queue 116 before it can be sent over the low bandwidth 
link 120. 

20 It will be appreciated, as indicated above, that the longest delay, indeed the only 
significant delay, the packet message will experience before transmission, is that 
resulting from being queued. The time-to-live setting, apart from its advantage in the 
prevention of an erroneous re-ordering of packet messages as explained above, is also 
of more general assistance in queue memory management. The packet message 

25 queue 1 16 could be swept, for example, when the queue 1 16 reaches a certain pre- 
determined length. Memory space otherwise taken up by timed-out packet messages 
may thereby be freed up. It would still be necessary, however, to check for timing-out 
on the sending of each packet. Alternatively, the queue 116 could be swept before it 
had reached this certain length. This would free up memory space otherwise taken by 

30 timed-out packets that might otherwise have lived on in a queue 116 shorter than the 
certain length. 
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The fruits of this approach to management of the low bandwidth link by the Link 
Manager process, combining cyclic priority settings with time-to-live settings are well 
demonstrated in and will be discussed having regard to, Figure 7 and Figure 8. 

5 A simulation was created as follows. A 'Server' process was set up on a single PC, 
with a small number of initial entities, each of which possess position state. A 'Client' 
process was set up with an identical state on the same machine and the two were 
connected via a 28.8 Kbit/s UDP/IP link via a 'reflector' machine (simply bouncing 
packets from the server back to the client). 

10 

The Server moved all the entities in random directions at a constant rate and, at a 
fixed periodicity for each entity (and hence accordingly, the assigned time-to-live for 
the packet messages of each entity), each sent a position update to the client. The 
cyclic priority settings in this example used n = 3, i.e. a four level priority scheme. The 
15 efficiency of the state transfer can then be measured by assessing the difference 
between the server and client state. With a perfect link (infinite bandwidth and zero 
latency) the states would be identical. With a non-perfect link the states will differ, 
and this difference can be measured by applying Pythagoras's rule to determine the 
distance between server and client entity positions. 

20 

This state difference for a given number of entities can be expressed as either. 

1 . An average of all the server-client position differences over a long period of time. 

2. The average of the maximum server-client position differences over a long period 
of time. 

25 

As the number of entities is increased the volume of state updates generated is 
increased, and hence the greater the load imposed on the server to client link. 

The approaches of sending with no priority and sending with a four level cyclic 
30 priority behave much the same with up to 25 entities sending data. This is because 
below 25 entities all the state updates generated within a fixed time period can be 
sent over the server to client link in the same period. 
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As the number of entities increases, and hence the volume of traffic sent to the client 
increases, the error detected for the non-prioritised case rapidly deteriorates. This is 
because the UDP link discards excess data, essentially making a random selection of 
the supplied updates. One entity might manage to transmit a sequence of 10 position 
5 updates successfully, whilst another manages to get none through over the same 
period. 

In contrast, between 25 and 95 entities the cyclic priority scheme shows a large 
improvement in both the average and the maximum error detected. This is because 
10 use of the cyclic priority ensures that when link bandwidth is exceeded each sending 
entity gets a fair sub-division of what is available. For example, when generated 
traffic is three times the available bandwidth (75 entities) the maximum error is 
around 4 times worse for the non-prioritised case. 

1 5 When the volume of traffic generated equals the link bandwidth multiplied by the 
number of priority levels then the priority scheme approach degenerates to the same 
error level as the non-prioritised approach. This is because not enough bandwidth is 
available to carry all the top priority state updates, and hence which updates are 
selected once again becomes a function of the network. This can be clearly seen on 

20 the maximum error graph, as the number of entities approaches 100. 

A third embodiment according to the invention will now be discussed having regard to 
Figures 1, 2, 3, 9, 10 and 11. This third embodiment differs from the first and second 
only in terms of the structure of the packet messages sent by the source entities and 

25 in the functionality of the Link Manager process, so appropriate reference should 
again be made to Figures 1, 2 and 3 where appropriate. Figure 9 illustrates a 
procedural flowchart of aspects of functioning of this second embodiment according 
to the invention. Again, the steps of the procedural flowchart will be carried out 
through execution of the software application programs running on the link 

30 management computer. 

According to this third embodiment and having particular regard to Figure 3, the 
source entities 100, 100' transmit packet messages 300 with the following structure. 



4 
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The first field 306 in the packet header 302 will be set with the identity of the 
sending source entity. The second field 308 in the packet header 302, identifying a 
destination entity, need not be set as there exists only one destination entity in this 
example. 

5 

The third field 310, identifying a priority setting, will again be set as with the first and 
second embodinnents. Each Individual packet nnessage is assigned a priority setting on 
a scale of for example, 0 (lowest priority) to n (highest priority). Again crucially, a 
sequence of n-i- 1 such messages is sent out from the source entity, not with a fixed 
10 priority assigned to the source entity in question, but with cyclically varying priorities. 
The cyclic priorities vary such that if packets were discarded on a priority basis, the 
remaining packets in the sequence would be left as evenly spaced as possible. 

Again, a simple example where n = 7, a corresponding suitable cyclic variation in 
15 priority is a sequence of eight messages with priorities set at O, 7, 2, 4, 1, 6, 3 and 5 
respectively. The 0, 7, 2, 4, 1, 6, 3, 5 sequence will ensure that as successive low 
priorities have to be dropped, a message with priority 0 being dropped first followed 
bya message with priority 1 and so on, the remaining packets will be as evenly 
spaced as possible. 

20 

In this third embodiment the fourth field 312, giving a time-to-live period, will not be 
set. In this third embodiment however, the fifth field 314 in the packet header 302, 
giving an indication of the packet payload type, is set. 

25 It will be recalled from the above discussion of the second embodiment that the 
setting of a time-to-live period by a sending source entity corresponded with the 
periodicity of the source entity. The example given above had a source entity sending 
packet messages every 20 nominal temporal units with a corresponding time-to-live 
of 20 nominal temporal units. Each packet message carrying a state update need not 

30 live longer than the source entity sending period since after another such period of 
time, a new state update packet message will have been sent. 
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In this third embodiment a time-to-live period is not set. Instead each source entity 
sends out state update messages with the fifth field 314 of the packet header 302 
set with an identification of the packet payload type, which in this example will be a 
position indication. Each source entity will thus send out state update packet 
5 messages only when it is necessary. 

According to this third embodiment, the Link Manager process 1 14 screens the 
incoming aperiodic packet messages, such that packet messages from the same 
source entity with the same payload type can be combined to make a new packet 
10 message with the latest possible state update. 

Thus, streams of such packet messages, again bearing cyclic priority settings, as 
discussed above, are sent out from the source entities 100, 100'. As with the first 
embodiment, these packet messages are then passed, via the respective server 
15 computers 104, 104', to the link management computer 110. 

Having regard to Figure 9, in a first step 900, after these packet messages are 
received at the first and second link management computer input ports 112, 112', 
they are then passed to the Link Manager process 1 14. 

20 

In a second step 902, when a new packet message is received at one of the the link 
management computer input ports 112, 112' , the Link Manager process 114 will 
read the first field 306 of the packet header 302, to determine the identity of the 
sending source entity. It will be recalled that in this embodiment, the second field 308 

25 in the packet header 302, identifying a destination entity, is not set as there exists 
only one destination entity in this example. In a third step 904, the Link Manager 
process 114 also reads the fifth field 314 in the packet header 302, giving an 
indication of the packet payload type, which in this example will be a position 
indication. In a fourth step 906, the Link Manager process 114 also reads the third 

30 field 310 of the packet header 302 giving the assigned priority setting. 

The Link Manager process 114 will again maintain a simple packet message queue 
1 16, ordered on priority as with the first and second embodiment. 
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In a fifth step 908, the Link Manager process 1 14 will then sweep this packet queue 
1 16, reading the first and fifth fields 306, 314 in the queued packet messages packet 
headers 302, to determine whether or not a packet message which has been received 
5 from that source entity and bearing that type of payload is currently being queued. 
Since it is assumed that packet messages sent from source entities arrive at the link 
management computer 1 10 with no significant delay, it will be assumed that a later 
arriving packet message carries a more recent state update than an earlier arriving 
packet message. 

10 

It is to be noted that since this match is performed on, at least the sending source 
identity and the payload type, each sending source entity will be free to denote 
whatever payload type it requires with whichever payload type indicator is wished ( 
i.e. source A might choose to denote a position payload with type = 1, whereas 
15 source B might denote a temperature payioad, for example, with the same type 
type = 1). 



Accordingly, if the Link Manager process 114 locates such an earlier packet message, 
from the same source entity and bearing the same type of payload, which is still 
queued, then in a sixth step 910, the Link Manager process will read the third field 
310 of the queued packet message packet header 302 giving the assigned priority 
setting. 

In a seventh step 912 the Link Manager process 114 may create a new packet 
25 message as follows. Having regard to Figure 2, the Link Manager process will write 
into the first field 306 of the packet header 302 of the new packet message, the 
common source entity identity read from the first field 306 of the packet header 302 
of both the newly received packet message and the queued packet message. The 
Link Manager process 114 will write into the payload section 304 of this new packet 
30 message the payload of the packet message just received by the link management 
computer, in other words the most recent state update available. The Link Manager 
process 114 will compare the priority settings in the third field 310 of the packet 
headers 302 of the queued packet message and the newly received packet message 
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and will write into the third field 310 of the packet header 302 of the new packet 
message, the higher of the two priorities of the queued packet message and the 
newly received packet message. 

5 In an eighth step 914, the Link Manager process 114, having created such a new 
packet message then sorts this new packet message into the simple priority order 
queue 1 1 6. 

In a ninth step 916, the Link Manager process 114 will discard the newly received 
10 packet message and the queued packet message. 

By way of an alternative, it will be appreciated that instead of the seventh and eighth 
steps 912, 914, the process might be carried out as follows. If the queued packet 
message had a higher priority than the newly received packet, then the payload of the 
1 5 newly received packet message could simply be copied into the queued packet 
message payload with the newly received packet message then being discarded. If, 
however, the newly received packet had a higher priority than the queued packet 
message then the queued packet message could simply be discarded and the newly 
received packet message sorted into the priority queue 1 16. 

20 

Where the Link Manager process 114 does not find a match on the criteria then in a 
tenth step 918 the received packet message will simply be sorted directly into the 
queue 116. 

25 With the third embodiment according to the invention, the Link Manager process 114 
will again test the link 1 20 for capacity to send the packet message at the head of 
the priority queue 116 before sending, as with the first and second embodiments. 

As with the first and second embodiments, for as long as the instantaneous total 
30 bandwidth of the packet message traffic received by the link management computer 
110 has been less than the known (low) bandwidth of the communication link 120, 
all packet messages placed in the Link Manager process queue 116 will be sent out 
on the link 120 with no queuing delay. The receiving entity will receive all the packet 
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messages sent from all the source entities. Again, as with the first and second 
embodiments, as the amount of packet message traffic increases, there will come a 
point when the total bandwidth of the incoming packet message traffic exceeds the 
bandwidth of the communication link 1 20. At this point it will again no longer be 
5 possible to send on simultaneously all the packet messages intended for the receiving 
entity. 

The third embodiment according to the invention will provide all the advantages of 
the first embodiment according to the invention in terms of the cyclic priority settings 
10 being able to deliver an optimal and graceful degradation of service as the total traffic 
bandwidth exceeds the low-bandwidth link capacity. The third embodiment according 
to the invention will, however, provide yet further advantages in terms of 
performance over the first embodiment, as will now be explained. 

15 The fruits of the approach to management of the low bandwidth link by the Link 
Manager process as discussed having regard to this third embodiment according to 
the invention are well demonstrated in and will be discussed having regard to, Figures 
10 and 11. 

20 A similar simulation to that discussed having regard to Figures 7 and 8 was 
conducted. This experiment shows the results of using no priority scheme at all, a 
cyclic priority scheme on its own, and a cyclic priority scheme with a message 
combination mechanism. In this example, a cyclic priority scheme with n==7, i.e. an 
eight level priority scheme, was used 

25 

Not using any priority scheme performs adequately up to the point where the volume 
of traffic generated on the server exceeds the bandwidth available for updating the 
client (30 entities). From this point on both the average and maximum error increase 
as state updates are discarded at random by the network. 

30 

The result of using an 8 level priority scheme on its own is shown as a dotted line on 
both graphs. This performs significantly better than the none-prioritised case at some 
traffic volumes (e.g. 70 entities and 90 entities), and significantly worse at other 
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traffic volumes (e.g. 35 entities). Each of the peaks in error from this data set 
correspond to when the traffic volume generated is equal to some integer multiple of 
the limited volume that can be carried between server and client. As discussed in an 
example above, the sequence of events that cause these peaks is: 

5 

1 . At time t Entity X generates state update St with priority P. 

2. St is queued because the link is currently fully utilised by higher priority updates. 

3. At time t+ 1 Entity X generates state update with St+ 1 with priority >P, 

4. St+ 1 is sent because it has a high enough priority to supplant any other queued 
10 traffic. 

5. Fluctuation in the generation of new state updates allows lower priority updates 
that have been queued to be sent, St is sent, and the receiving entity on the client 
treats this as update St + 2. 

1 5 Hence these error peaks are only generated when fluctuations in the rate of state 
update generation can cause the above re-ordering case, i.e. when the traffic volume 
generated is close to some integer multiple of the available bandwidth, and one 
particular priority level is only occasionally making it onto the low bandwidth link. 

20 This problem is resolved by the third embodiment according to the invention, shown 
as the dashed line on both graphs, wherein new messages are combined with any old 
queued messages from the same entity. Hence, the type of re-ordering problem 
outlined above is eliminated, and the scheme performs well at all traffic levels. 

25 Having regard to Figure 3, and in particular the second field 308 of the packet header 
302, it will be appreciated that it is possible to send to multiple clients from a single 
link manager if respective different destination entity identities are provided. The Link 
Manager process may then maintain multiple sorted priority packet message queues, 
on the basis of, for example, one such queue per client. 



30 



Thus the destination entity identity field may be used by the link manager to 
determine which queue any incoming packets should be placed in. Having used the 
packets 
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destination field to determine the relevant queue, the link manager may then utilise 
the mechanisms previously described to place the packet in the queue and then either 
deliver or discard it. It will be appreciated that once the link manager supports 
multiple clients, and hence multiple priority sorted packet queues, it will need to 
5 round-robin between 

these queues, allowing each of them processing time to send any packets from the 
head of their queue that the link to their client may carry at that moment in time. 

Figure 12 illustrates a fourth embodiment according to the invention. 

10 

Each client 1200, 1202, 1204 is treated as a single receiving entity 1206, and has 
zero or more sending entities 1208 resident on it. All clients are connected to a link 
manager 1210. Each client 1200, 1202, 1204 can generate any number of updates 
from any of its sending entities, and address these to any of the other client 

15 receiving entities. Each update is sent to the link manager 1210, and this has the task 
of distributing the incoming updates to the relevant clients 1200, 1202, 1204. Since 
any single client 1200, 1202, 1204 may be receiving updates from numerous other 
clients 1200, 1202, 1204 a fan-in type problem occurs, whereby each client is only 
generating a limited number of updates, but particular clients are being sent a larger 

20 number of updates than the bandwidth of their network connection allows. 

To handle this problem effectively the link manager 1210 maintains a priority sorted 
queue 1212, 1214, 1216 for each client, and this queue 1212, 1214, 1216 is 
emptied down to the client 1200, 1202, 1204 at whatever bandwidth the link 

25 manager to client link can support. These queues 1212, 1214, 1216 are managed 
using the previously described cyclic priority scheme, whereby each update is 
allocated a priority by the client as its generated, together with either a time to live or 
a payload type. Hence, if any client is being sent more updates than its link 
bandwidth will allow it to receive the link manager will act to ensure that graceful 

30 degradation in the periodicity of the updates received occurs. 

This approach assumes that the upstream traffic generated from client to link 
manager will not exceed the available link bandwidth, i.e. that the client can regulate 
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the periodicity of updates generated by the sending entities to ensure the total traffic 
generated in any single time period remains below the maximum it can transmit 
within that same period. If this is not the case then an identical scheme to that 
employed at the link manager can be adopted for use at the client i.e. a priority sorted 
5 queue, messages sent from its head at whatever rate the link bandwidth allows, and 
with a time to live or data combination approach used to constrain the queue size and 
prevent message re-ordering. 

In this implementation each message would pass through up to two queues, one 
10 before leaving the client, and one at the link manager whilst awaiting delivery to a 
client. Note that if using a time to live approach with this double queuing scheme, 
then the time to live in the message must be correctly adjusted before a message is 
sent. For example, if a message is generated at t = 0 with a TTL of 20, and remains in 
the client-side queue for 5 time periods, then it should be sent up to the link manager 
15 with a TTL of 1 5 (i.e. Original TTL minus the time spent in the queue). 



20 
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CLAIMS 

1 . A Link Manager for managing the sending of packet messages on a link; 

the packet messages originating from a plurality of packet message sources; 
5 each packet message source having an associated state; each packet message 

including an associated packet message priority setting on a scale of n to m 
and a packet message source state update; 

each packet message having been sent by a source sending sequences of m - 
n+1 packet messages cycling through each priority setting of said priority 
10 setting scale such that successively dropping packet messages from the 

sequence on a priority basis leaves the remaining packet 
messages of the sequence as evenly spaced as possible; 

the Link Manager comprising: 

15 

at least one packet message input port to receive such packet messages; 

means arranged to read the priority setting associated with each such received packet 
message 

20 

means arranged to sort each such received packet message into a packet message 
queue on the basis of the priority setting associated with each such received 
packet message; 

25 means arranged to test the link for sufficient capacity to send the packet message at 
the head of the queue; and 

means arranged to send the packet message at the head of the queue, when the link 
has sufficient capacity, out through at least one output port onto the link. 

30 

2. A Link Manager as claimed in claim 1 wherein each packet message 
further includes an associated packet message time-to-live setting, the Link 
Manager further comprising: 
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means arranged to read the packet message time-to-live setting associated 
with each packet message from each received packet message; 

5 means arranged to associate at least one indication of a period of time each 
packet message has been queued with each respective packet message; and 

means arranged to discard each packet message whose associated indication 
indicates that the packet message has been queued for a period of time 
10 longer than the packet message time-to-live setting associated with each 
packet message. 

3. A Link Manager as claimed in claim 2 further comprising: 
15 a clock; and 

means arranged to replace the packet message time-to-live setting associated 
with each packet message with an adjusted time-to-live setting comprising 
the sum of the time-to-live setting read from the packet message and the 
20 local time at which the packet was received; 

and in which the means arranged to associate an indication of a period of 
time with each packet message, associates with each packet message arriving 
at the head of the priority queue, the sum of said adjusted 
25 time-to-live read from each said packet message minus the 
local time at which said packet message arrived; 

such that the means arranged to discard each packet message are so arranged to 
discard a packet message if said associated sum is less than or equal to zero. 

30 

4. A Link Manager as claimed in claim 1 wherein each packet message further 
includes a packet message source identity and an associated packet 

message payload type setting, the Link Manager further comprising: 
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means arranged to read the packet message source identity associated with 
each packet message from each received packet message; 

5 means arranged to read the packet message payload type setting associated 
with each packet message from each received packet message; 

means arranged to test the packet message queue for a queued packet message with 
an associated source identity matching that of the received packet message; 



means arranged to read the priority setting associated with the matching queued 
packet message; 

means arranged to sort into the queue on the basis of priority a packet message 
15 replacing the matched received and queued packet messages, having the associated 
source identity of the matched received and queued packet messages, the payload of 
the received packet message and whichever of the associated priorities of the 
matched received and queued packet message is the higher . 

20 5. A method of managing the sending of packet messages from a plurality of sources 
on a link; 



10 



25 



the packet messages originating from a plurality of packet message sources; 
each packet message source having an associated state; each packet message 
including an associated packet message priority setting on a scale of n to m 
and a packet message source state update; 



30 



each packet message having been sent by a source sending sequences of m - 
n+1 packet messages cycling through each priority setting of said priority 
setting scale such that successively dropping packet messages from the 
sequence on a priority basis leaves the remaining packet 



messages of the sequence as evenly spaced as possible; 



the method comprising: 
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receiving such packet messages at at least one input port of a link manager; 
reading the priority setting associated with each such received packet message; 

5 

sorting each such received packet message into a packet message queue on the 
basis of the priority setting associated with each such received packet message; 
and 

10 sending the packet message at the head of the queue out through at least one 
output port of the link manager onto the link. 



i 
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ABSTRACT 

PACKET MESSAGING METHOD AND APPARATUS 



There exists a certain class of packet messaging problems where a number of 
5 competing yet equally important packet message sources are all transmitting the 
same type of packet message and these packet messages are to be sent over such a 
low bandwidth link that congestion will occur. The result of this congestion will be 
that not all the packet messages sent from the number of packet message sources 
will be able to be carried on the link. One example of such a situation is a distributed 

10 game architecture where entities hosted in a virtual environment on, for example, a 
server computer, transmit packet messages containing updates as to their respective 
positions in the virtual environment. These packet messages might then be 
transmitted over a low bandwidth to the client computer of a game player. If a 
present day scheme, such as a layered video coding type scheme, were applied to 

15 select which packet messages could be carried on the link, then the client would have 
a good deal of knowledge about the state of some entities but very little knowledge 
about the state of others, which may be a critical disadvantage. According to the 
invention, packet messages are sent with an associated packet message priority 
setting on a scale of 0 to n, in sequences of n+1 packet messages cycling through 

20 each priority setting in the priority setting scale. In this way, if packet messages are 
dropped from the sequence due to congestion on a priority basis, the remaining 
packet messages of the sequence as left equally spaced as is possible. Thus, as the 
link bandwidth capacity is exceeded and packet messages begin to be dropped, or 
rather queued, on a priority basis, the packet messaging method and apparatus 

25 according to the invention ensures that, as far as possible, regular update packet 
messages are still received from all packet message source entities. 
Figure (x) 
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